Real Time Relighting with Dynamic Light Environment Using an RGB-D Camera

Relighting techniques often require knowledge about the shape and the reflectance property of a target object and the light environment. The quality of the relighting is highly dependent on the normals accuracy of the object since they are used for the computation of the illumination. We propose a new relighting approach for arbitrary shaped objects with dynamic light environment using an RGB-D camera such as the Microsoft’s Kinect. The generated depth map is useful to estimate the normals of the object, but it’s inaccurate because of the noise such as discrete depth values or missing data. We focus on the depth map modification to segment the accurate object region, and normal estimation for relighting. Our implementation achieves a relighting at 10fps with GPU. Therefore, our relighting system can apply for a moving object and a dynamic light environment in real time. Keywords—Relighting, GPU, RGB-D camera.